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ABSTRACT: This paper outlines a three-step plan for generating English text from any semantic 
representation by applying a set of syntactic transformations to a collection of kern:! sentences, the paper 
focuses on describing a program which realizes the third step of this plan. Step. Ope sepututes IK given 
representation into groups and generates from each group a set of kernel sentences, atop lyyo must aecide 
based upon both syntactic and thematic considerations, the set of transformations that should be pciloimc. 
upon each set of kernels. The output of the first two steps provides the ’TASK" for Step three. Each 
element of the TASK corresponds to the generation of one English sentence, and in earn may be defined as a 
triple consisting of: (a) a list of kernel phrase markers; (b) a list of transformations to be pci loaned upon tie 
list of kernels; (c) a "syntactic separator" to separate or connect generated sentences. Slcp Jim takes 
input the results of Step One and Step'Two. 'The program which implements Step ihrcc reads the 1ASK, 
executes the transformations indicated there, combines the altered kernels of each set into a sentence, 
performs a pronominalization process, and finally produces the appropriate English word string I his 
apnroach subdivides a hard problem into three more manageable and relatively independent pieces. It uses 
linguistically motivated theories at Step 'Two and Step Three. As implemented so tar, Step Ihrcc is small 
and highly efficient. The system is flexible; all the transformations can be applied m any order. Ihc system 
is general; it can be adapted easily to many domains. Below is an actual example of English text genet ate 

by "the program from the kernels and transformations of an appiopiiatc input 1 ASK. 

"At the beginning of the story Lady Macbeth is bothered by the fact that Macbeth is not the king. Macbeth who was 
a nobleman is persuaded by her to murder the king with a knife because she wants Macbeth to be the king. She dies and 
Macbeth becomes unhappy. Macduff didn't see Macbeth murder the king. In the end Macbeth is killed by Macduff who 
was a good friend of the king. Were there some other stories written by Shakespeare?" 
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§0. Introduction 

Suppose that a computer contains a semantic representation of a certain seque tee of events oi facts. 
For many reasons, it is useful to generate English text from such a representation. This paper 
outlines a three-step plan for generating, English text from any semantic representation by applying 
a set of syntactic transformations to a c< llection of kernel sentences or phrase markers. The papei 
f ocuses on describing a program called GEN which realizes the third step of this plan. 

Step One of the Language Generation Procedure (LGP) separates the given semantic 
representation into groups and generates from each group a set of kernel phrase markers. A phrase 
marker can be used in otic of several syntactic roles: a matrix clause K Q , an embedded clause K v or 
a relative clause K r The role of a given phrase marker must be specified in Step One. 

Step Two of the LGP must decide, based upon both syntactic and thematic considerations, the set 
of transformations that should be performed upon each set of kernels. 

The output of the first two steps provides the input for Step Three. We will sometimes refer to this 
input as the "TASK" for Step Three. Each element of the TASK corresponds to the generation of 
one English sentence, and in turn may be defined as a triple consisting of: 

(a) a list of kernel phrase markers generated by Step One; 

(b) a list of transformations, obtained from Step Two, to be performed upon the list of 
kernels; 

(c) a "syntactic separator" (punctuation mark, conjunction, etc.) to separate or connect 
generated sentences. 

Step. Three Likes as input the results of Step One and Step Two. The program GEN which 
implements Step Three of the generator "reads" the TASK, executes the transformations specified 
there, combines the altered kernels of each set into a sentence, performs a pronominalization 
process, and finally produces the appropriate English word string. 


1 The definition and the structure of kernel phrase markers {Semantic Frame Structure) is described in Section 1. 
2. A comprehensive review of previous approaches to language generation can be found in [McDonald 1980]. 
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n trod action 


For example, given the following kernels: 


.3 


K n = a young woman asked it 
K = this man ate the cake 


( 1 ) 


the program can apply different sets of transformations for altering the individual sentences or 
combining them. Among (he possible outputs are: 3 4 * * 


1. After 0-NP -TO : A young woman asked this man to cat the cake. 

2. After QUBSTION: Did a young woman ask this man to eat the cake? 


3. After NOT : Did a young woman ask this man not to eat the cake 9 

4. After PASS1VK: Was this man asked by a young woman not to cat the cake? 


( 2 ) 


5. After NT: 


Wasn't this man asked by a young woman not to eat the cake? 


Suppose that the program GEN takes as input the following TASK: 

TASK I = ((K fl Kj) (O-np.-to^ Question) (?)) 

According to this TASK, the program applies the transformation O-np^to to the embedded clause 
K and the transformation Question to the matrix clause K 0> Then the altered kernels are combined 
and the resulting output is: "Did a young woman ask this map to eat the cake?" which is sentence 
#2 in (2). If, for instance, we want to obtain sentence #5 from the set (2) above, the input TASK 
should be: 

; * )*•*» v... . »• • • • • . . , . 

TASK2 = ((K Kj) (0-np l -to l Questipn Nof Passive N't) (?)) 

The last step of the Language Generation Procedure uses three different classes of syntactic 
operations to "solve" the TASK provided by Step One and Stpp Two: the system of optional 
commutative Transformations , the set of Transformational Tillers whose application is obligatory 
only if certain conditions are met, and the set of intrinsically ordered, obligatory Adjustments. 


3. The word it is used here as a joining point. 

4. for convenience, we append T’ Iq the name of a transformation which will be applied to an embedded clause, and 

"T to a transformation that will be applied to a relative clause. Noting’ is' appended Ip'Uip matrix dause. T}ie 

significance of the names of transformations, sijch as 0-NPj-ICh will be explained below ip Section 6. 


A t 
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Below is an actual example of Fnglish ;e\t generated by the program OKN I'rom the kernels and 
transformations of,an appropriate input TASK: 5 


An old professor wanted .1 large Fnglish class to learn a story about 
Macbeth. He didn't notice a young man and a young lady eating a huge 
cake under the desk. They were in danger, weren't they? Fortunately the 
people who loved the story about Macbeth did not see them either. Hear it 
now! At the beginning of t ic story Lady Macbeth is bothered by the fact 
that Macbeth is not the king,. Macbeth who was a nobleman is persuaded 
by her to murder the king with a knife because she wants Macbeth to be 
the king. She dies and Macbeth becomes unhappy. Macduff didn't see 
Macbeth murder the king. In the end Macbeth is killed by Macduff who 
was a good friend of the ki ig. Were there some other stories written by 

Shakespeare? 6 


The pronouns found in this example were not present in the input TASK, 
program. 7 


but were created by the 


Among the advantages of this approach are: 


- it nicely subdivides a hard problem into three more manageable pieces, such that each 
relati vely independent of the others 

- it uses linguistically motivated theories at Step Two and Step Three of the LGP 
-as implemented so far, Step Three is small and highly efficient 

- the system is flexible; all the transformations can be applied in any order 


is 


- the system is very general; it can be adapted easily to many domains. 


5 . The following fragments show the structure of the TASK: 

(K = An old professor wanted it; K, = A large English class learns a story about Macbeth) (0-np^to^) (.) 

U * 

(K Q ~Macduff saw it; K ] -Macbeth murdered the king) (N't 0-np^inf^ (.) 

(K 0 = In the end Macduff kills Macbeth; K 2 = MaccUifT wasagood friend of the king) ( Relative 2 Passive) (.) 

(Kq —Shakespeare wrote some other stories) (Question Passive There) (?) 

6. The author apologizes for possible historical inaccuracy in the computer output. 

7. The pronominalization procedure is described in the Appendix 1. 
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§1. Semantic Frame Structure 


We will assume that the input semantic representation consists of a set of frames. 8 Step One of the 
Language Generation Procedure builds from the given representation a set of Kernel phrase markers 
using three types of templates (noun-template, verb-template, adverb-template) and two operations 
(concatenation and conjunction) that assemble them. The structure of the templates is shown 
below: 


noun-template (NT) = (prep dot adj* non 


verb-template (VT) = (tense au> 1 aux2 aux3 verb) 
adverb-template (AT) = (mod adverb) 


Her c prep, del, adj, aux, mod are, respectively, abbreviations for preposition, determiner, adjective, 
auxiliary and modifier. The superscript * indicates that a string of one or more symbols or their 
conjunction is allowed. Tense also carries the grammatical features of NP - its number, person, 
and gender. 

Each template is implemented as a list of pairs, an association list. The first element of the pair is 
the name of the constituent, the second is its value. All constituents are optional. If any constituent 
is absent, its value in the template is nil. 

Given below are some sample templates: 


NI 


NT = ((prep nil) (det a) (adj (young pretty)) (noun lady)) 

= ((prep with) (det (all the)) (adj nice) (noun books)) 

= ((prep (from out of)) (det the) (adj nil) (noun darkness)) 

: ((tense past) (auxl can) (aux2 have) (aux3 nil) (verb notice)) "could have noticed' 


"a young pretty lady" 
"with all the nice books" 
"from out of the darkness" 


VT .= 

AT = ((mod very) (adverb well)) 

The following two operations are allowed: 


tt 


very well 


n 


8, flie term "Lame" was introduced in [Minsky 1975], the Frame Representation Language (FRL) developed in 
[Roberts and Goldstein 1977} can be usee as an example of such representation. In this paper, however, for testing 
purposes we will consider a set of kernel phrases as the input. A parser has been designed and implemented in order to 
process the kernel phrases. The description of the parser can be found in the Appendix 2. 
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1. Concatenation: 


CONC (XI X2) --> XI 




2. Conjunction : C'ONJ (XI X2) --> XI conj X2 


v'liere XI and X2 are two templates of the same type, and conj is a conjunction such as, and, or, etc. 


I lie structure of the frames can be defined in terms of the templates and operations, as follows: 


Nounzfjwm (NF) is any appropriate 9 secpience of applications of the operations CONC and 
CONJ applied to the noun-template NT. 

Verb-frame (VF) and ad v erb-fram e (AF) are defined in the same manner, as a sequence of 
applications of CONC and CONJ applied to VT and AT, respectively. 10 

The noun-frame will be called prepositionless if it does not begin with a preposition. 

For example: 


NF - ((prep nil) (det nil) (adj nil) (noun Ivan) (conj and) 

(prep nil) (det nil) (adj nil) (noun Maria)) = "Ivan and Maria". 

Each of the prepositionless noun-frames in a sentence has a particular semantic role associated with 
it: agent, goal, or theme. 


Agent is a thing that causes the action to occur. 

Goal is the recipient or the beneficiary of the action. 

Theme is a thing that undergoes a state of change. 

As an example, in the sentence "Ivan gave Maria all his money", Ivan is the agent who causes the 
action to happen; Maria is the goal, as the beneficiary of his action; and all his money is the theme 

that transfers from Ivan to Maria. 

To construct a kernel phrase marker we have to put together a subset of the following set of frames. 

j^pinitial pjpagent pjpgoal pjplhcmc^ ^jplind ^pimtial^ y^pmcdial^ ^p-final^ VF (3) 

Here NF ; ' ecr ", NF eoal , and NF thcme are noun frames that play, respectively, the roles of agent, goal. 


9. The present paper will not discuss restrictions on the usage of these two operations. This issue properly belongs to 
Step One of the Language Generation Procedure. 

10. In the implementation we have assumed that the verb-frame VF = tense auxl aux2 aux3 verb. 
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or theme in a sentence; 11 NF'" ilial and NF 1 " 1 ''' 1 are noun frames that will he transformed later into 
the initial and final prepositional phrases; AF imna! , AF medml , and AF nnal are adverb frames that will 
be transformed into adverbs in initial, medial, and final positions. All these elements are optional. 

In the actual implementation kernel pi rase markers have the structure of an association list. We 
will call it a Semantic Frame Structu re (SFS). The English word string corresponding to the 
Semantic Frame Structure of a kernel phrase marker we will call a kernel sentence, 

■ ■ \ 

For instance, the Semantic Frame Structure for the kernel sentence "Yesterday the young man 

bought Maria a beautiful present" is: 

((AF il,itial ((mod nil) (adverb yesterday))) 

t 

(NF' pl ((prep nil) (det the) (adj young) (noun man))) 

(VF ((tense past) (auxl nil) (aux2 nil) (aux3 nil) (verb buy))) 

(NF 8 - 1 ((prep nil) (det nil) (adj nil) (noun Maria))) 

(MF' he "» ((prep nil) (det a) (adj beautiful) (noun present)))) 

A set of such Frame Structures together with a set of transformations to be performed upon them is 
the input to the program GEN. The program does not require any order of constituents in the SFS, 
but the following phrase structure rules arc assumed for kernel sentences: 12 

KF —> SF VF CF 


SF —> NF 


initial 


NF 


agent 


(4) 


q; fsjpgoal jsjplhcme jyjpfinal 

where KF stands for kernel frame, SF - subject frame, VF - verb frame, CF - complement frame. 
Given these phrase structure rules, the general form of a kerne! phrase marker is: 

jSjpinitia] pjpagent yp ^ pgoal j^ptheme pflnal (5) 

As an example, here is the Semantic Frame Structure for the sentence "that young man with black 
eyes could have been teaching our class in Boston": 


11, In Section 7 we will describe how the semantic roles associated with the noun-frames are used to define the 
transformation Dative Movement and its interaction with Passive. 

12. Adverb-frames AF' 11 ' 1 ' 1 ' 1 , AF nll ' dial , and AF llna ’ have been, for simplicity, left out of the phrase structure rules. 
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((NP'S"" ((prep nil) (del that) (adj young) (noun man) 

(prep with) (del nil) (adj black) (noun eyes))) 

(VF ((tense past) (auxl can) (au\2 have) (aux3 be) (verb teach>)) (6) 

(NF lhtir “ ((prep nil) (det our) (adj nil) (noun class))) 

(NF fi ” al ((prep in) (det nil) (adj nil) (noun Boston)))) 


§2. Transformational Structure 

The Semantic Frame Structure provides a semantic description of a kernel sentence which includes 
constituents such as NF 8cnl , NF* 4 , arid lMF ,hemc . Because these semantic constituents represent in 
some sense a part of the underlying "meaning" of the sentence, their valuer do not change after 
applying transformations. However, the SFS does not give a syntactic lepicsentation complete 
enough to allow transformations to be directly applied. We must first construct an augmented 
representation from the Semantic Frame Structure, the Transformational Structlire (IS), which 
gives a structural encoding of the information in the sentence. This structure will serve as the 
domain of application for all transformations. The Transformational Structure consists of syntactic 
constituents such as noun phrases (NP), prepositional phrases (PP), auxiliaiy system, seveial dummy 
elements, etc. The process of building the Transformational Structuie from the Semantic Fiame 
Structure is described as follows: 

(a) The noun phrases and the prepositional phrases of the TS are derived from the noun frames of 
the SFS. Each noun phrase indicates a certain fixed position in the Transformational Structure: 
NP-position, NP -position, or NP 2 -position. 13 Each noun phrase is associated with one of the 
prepositionless noun frames NF asc,,t , NP oal , or NF ,hcmc in the Semantic Frame Structure and 
derives its value from the noun frame. The value of a noun phrase is a two-tuple , it consists of a 
semantic value, which is taken from the name of the noun frame and which indicates the role that 
the noun phrase plays in the sentence: agent, goal, or theme , and a lexical value, which is the actual 
word string in the noun phrase. Transformations (for example, Passive or Dative Movement) may 
interchange the values of noun phrases; therefore, after such a transformation has been applied, the 
affected noun phrase receives not only the new word string as its lexical value, but also the new 


13 Later on by a reference to a noun phrase NPj, NPj 5 . or NP 2 , we will mean Uie noun phrase which is located in the 
corresponding position in the Transformational Structure. For instance, reference to NPj calls for a noun phrase in the 

NPj-position in the TS. 
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semantic role as its semantic value. In Section 7 we will describe how this important feature is used 
to define the transformations of Dative Movement and Passive. 


We will assume that the noun phrases NP , NP , and NP initially obtain their values from the 
Pames NF senl , NF oal , and NF" 1(m> , respectively. If only two noun frames NP C '"' and NF lhcme 
i re present in the input Semantic Frame Structure, the corresponding Transformational Structure 
will have only two NP-positions: NP and NP . 14 If there is only one noun frame NF a8Cnl in the 
SFS, there will be only one noun phrase NP in the TS, The Semantic Frame Structure in the 
example (6) will be transformed to: 15 


((NP (That young man with black eyes)) 

(TENSE past) (AUX1 can) (AUX2 have) (AUX3 be) (VERB teach) 
(NP, (our class)) (PP nnal (in Boston))) 


(7a) 


(o) A special procedure, "affix stripping", is accomplished on the auxiliary elements of the 
verb-frame to separate each auxiliary verb from its affix. 16 The affixes of the auxiliaries Modal, BE, 
and HAVE are. respectively, 0 , en, and ing. The notation reflects the fact that in an English 
sentence after a Modal comes an infinitive, after HAVE comes the past participle, and after BE 
comes the progressive form of the verb [Chomsky 1957], If the sentence has no auxiliary verbs in it, 
the auxiliary do (without an affix) is inserted as a value of the AUX1. 


((■NP (That young man with black eyes)) 

(TENSE past) (AUX1 can) (AFFIX1 0) 

(AUX2 have) (AFFIX2 en) (AUX3 be) (AFFIX3 ing) (VERB teach) 
(NP, (our class)) (pp fin:U (in Boston))) 


(7b) 


(c) Several dummy elements are inserted in the TS which are left unspecified 17 until the appropriate 
transformation activates them and assigns the necessary values. Two elements NEOT and NEG2 
that will be used in the contracted and full forms of English negative are inserted after the first 
auxiliary verb. COMP is inserted in the beginning of the structure and 1NFE - before the first 
auxiliary verb. These will be used in constructing different embedded clauses. Thus the Semantic 


14. This is the reason for having the obscure indices 1,1.5, and 2 for the noun phrases. 

15. In these diagrams we do not show the semantic values of the noun phrases. 

16. 7he inverse operation, Affix Hopping , which is performed after all the transformations have been applied, attaches 
every affix to the immediately following verb. 

17. In the implementation the values of unspecified elements NEG1, NEG2, COMP, and INFL are names of those 
elements. 
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Frame Structure (6) has now been transformed into Transformational Structure (7c) on which 
transformations can operate: 


((COMP comp) (NP (That young man with black eyes)) 

(TKNSF, past) (INI I in 11) (AUX1 can) (NFG1 negl) (NEG2 neg2.) (AFFIX! 0) 
(AUX2 have) (Af'I : IX2 en) (A JX3 be) (AFFIX3 ing) (VERB teach) 


(7c) 


(NP 2 (our class)) (PI 


ynhnal 


(in Boston))) 


( he Transformational Structure of a kernel sentence is a flat list structure which suggests a more 
simple and flexible way to define an i perform the transformations. On the other hand, the 
sentence obtained after combining several kernel sentences is represented as an embedded list 
structure (tree structure). This allows the application of the transformational filters across the 
kernels (see Section 6), and also permits an easier interface with the results of other researchers, for 
example, sentence internal pronominali/ation (see [Lasnik 1976], [Reinhart 1976], [Sidner 1979]). 


§3. Transformations and Adjustments 

Let K be a surface word string that corresponds to the input Semantic Frame Structure. In Section 
1 it has been described how the Semantic Frame Structure SFS(K) is mapped into the 
Transformational Structure TS(K). The Transformational Structure serves as the domain of 
application for all Transformations listed in the input TASK. However, after all the transformations 

.J 

have been applied, the resulting Transformation Structure TS (K) cannot yet be the source for the 

correct English word string. Additional "clean-up" operations on the Transformational Structure, 

* 

Adjustments, must be employed in order to obtain the grammatical output - the altered kernel K . 
Let us consider this process in detail: 

(a) The Semantic Frame Structure of the kernel sentence K is mapped {M} into a 1 ransformational 
Structure 'fS(K). 

(b) A set of transformations fI} is applied. Each transformation operates on die [ransformational 
Structure, alters it and passes the altered structure to the next transformation. 

(c) A set of special "clean-up" adjustments {A} is activated in order to get the terminal English word 

* , * 
string K . The adjustments operate on the altered Transformational Structure TS (K). 

The following diagram (8) illustrates this process: 


{M} 

SFS(K) .> TS(K) 


m 


{A} 


> TS (K) 


■> K 


( 8 ) 
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Diagram (8) provides a way to define Transformations and Adjustments which shows an interesting 

and important distinction between them based on comparing the input kernel sentence K with the 

* 

output word string K . 


Definitions: 


Assume that the set of transformations {T} is empty. A set of operations {A} on the 
Transformational Structure T'S(I<) of an input kernel sentence K will be ca led Adjustments if in 

:fc 

diagram (8) the following equality holds: K = 


An operation T on the Transformational Structure TS(K) of an input kernel sentence K will be 
called a Transformation if in diagram fT) the following inequality holds: K =* K . In this paper we 
will use the notation T(K) to refer to me English word string that corresponds to the result of the 
action of the transformation T on TS(K). 

According to these definitions, such operations as Passive, Question, There Insertion , 18 etc. are 
Transformations because they alter the original sentence. For example, as the result of successive 
application of these transformations the sentence "Ivan ate a carrot" will be transformed into 
"A carrot was eaten by Ivan", "Was a carrot eaten by Ivan" and then to "Was there a carrot eaten 
by Ivan." The transformations are part of a planning vocabulary, that is, each of them must be 
listed in the input TASK. 

On the other hand, the obligatory operations like Affix Hopping, Do Deletion, N't Hopping, etc. 
together constitute the clean-up Adjustments 19 of the Transformational Structure whose goal is to 
obtain the necessary English output after all the transformations have been applied. They never 
appear in the input TASK. If the set of transformations {T} is empty, the original kernel sentence 
K will not be altered. 

Adjustments are meaning-preserving, purely syntactical operations on the Transformational 
Structure. Transformations, on the contrary, can affect the meaning (or emphasis) of a kernel 
sentence. In fact, the meaning of a sentence obtained after combining several kernels altered by 
transformations is built with the help of these transformations. In that sense, one can consider 
Transformations as semantic (meaning-altering) operations on the Transformational Structure. 


18. The description of these transformations will be given in Section 7. 

19. Section 5 exaniines the Adjustments and the Separation and Ordering Constraints imposed upon them. 
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§4. Commutativity 


Definitions: 


Oo main of Definition fi(T) of a transformation I is the set of all sentences K such that T(K) is a 
o-ammatical sentence. The fact that the sentence K belongs to the domain of definition of the 
transformation T is expressed in the following way: K C 12(1). 

1 wo transformations and T ? are commutative with respect to a set of kernel phrase maikeis K if 
for each phrase marker K C H the following relations hold: 


and 


KCQCT,), KCO(T 2 ), T,(K)CS2('r 2 ), T 2 (K) C 12(^1 

Tj(t 2 (k)) = jp\m 


(9) 


( 10 ) 


In other words, the transformations T, and T 2 are commutative if the equality (10) holds for the 
corresponding domains of definition of Tj and T 2 . 

As an example, let us consider again the sentence K = "Ivan ate a carrot. The commutativity of 
tne transformations T p = Passive and T y = Question can be checked for this sentence because all 
the four outputs are"grammatical and T p (T Q (K)) = T Q (T p (K)), i.e. we have the following 

commutative diagram (11): 


K = I van ate a carrot 


Question 

.> T (K) = Did Ivan eat a carrot 


Passive 


Passive 


(ID 


Question 


T (K) = A carrot was eaten by Ivan 

P 


■> T p (T (K)) = Was a carrot eaten by Ivan 


Considering another pair of transformations: T 


Passive and T 


There Insertion shows that 


the commutativity of the transformations T p and T. n cannot be checked for the sentence K 
"Ivan ate a carrot." The transformations can be applied in the order: 1. Passive , 2. There Insertion, 

resulting in: 
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T (K) - A carrot was eaten by Ivan. 

T t| (T p (K)) = There was a carrot eaten by Ivan. 

But it is not possible to apply the transformations T p and T. n in the reverse order because the 
sentence K does not contain the verb be, which is necessary for There Insertion to work. This does 
not mean, however, that the two transit rmations: Tussive and There Insertion are not, or cannot be 
made, commutative. The previous example does not contradict our definition of commutativity 
because the sentence K in this example does not belong to the domain of definition of the There 
Ii'sertion transformation. 

A similar problem arises with the sentence: K = "A boy was eating the cake," Here it is possible to 
apply either T = Passive ; 


orT = There Insertion: 


T (K) = The cake was being eaten by a boy 


T (K) = There was a boy eating the cake 


But we cannot apply There Insertion after Passive, nor can we apply Passive after There Insertion. In 
both cases the result will be unacceptable 20 because the noun phrase the cake is definite, but There 
Insertion is restricted to sentences with an indefinite first noun phrase: 

* There was the cake being eaten by a boy 
The following diagram (12) illustrates this example: 


There Insertion 


K - A boy was eating the cake 


•> T (K) = There was a boy eating the cake 


Passive 


There Insertion 


Passive 


( 12 ) 


T (K) = The cake was being 

r 


eaten by a boy ..> * There was the cake being eaten by a boy 


20. The asterisk * before a sentence indicates that the sentence is "unacceptable”, or ungrammatical. 
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Again. as in the previous example, the I act that we can apply both 1 p and 1 n to the sentence K, but 
cannot apply T to T (K) or T p to T. n (K), docs not mean that there is no commutativity in the 
system. It means only that in this case t he sentence K is irrelevant to the question of commutativity 
because K does not satisfy the conditions (9) specified in the definition of commutativity; K does 
not belong to the set of kernel phrase markers K with respect to which commutativity was defined. 

One of the requirements that we impose upon the system is the possibility to apply the 
transformations in any order (equality (10)). Once this is done, the domain mt mbership (conditions 
(9)) becomes crucial: all the sentences obtained at each step of the transfoimotion derivation must 

be grammatical. 


Definition: 

N transformations T T 2 ...T are commutative with respect to a set of kernel phrase markers H if 
for any i and j the two transformations T. and T are commutative with respect to the set 8 and it for 
any m < N the result of application of any composition of m different transformations 1. 1 'j ... T.^ 

to a sentence KCH: T. (T. ... (T (K))...) is a grammatical sentence. 

‘l *2 m 

In this paper we will build a system of Commutative Transformations that will permit us to solve 
the TASK given by Step One and Step Two of the Language Generation Procedure and to generate 
corresponding English text. The commutativity of the system gives more flexibility to the first two 
steps of the LGP. The decisions of how to separate the input semantic representation into groups of 
kernel phrase markers and which of the transformations to apply will not depend on the ordei of 
the transformations. It will be based only on the domain of definition of each particular 
transformation and on the meaning that this transformation adds to the meaning of the generated 

sentence. 


§5. Adjustments 

This section will examine the clean-up Adjustments, operations which further alter the 
Transformational Structure after all the transformations liaye been applied, in order to obtain the 
correct English output. We will start with an example. Consider the following kernel sentence 
K — "Ivan was eating potatoes." The 1 ransformational Structure 1S(K Q ) foi the keinel K fl is 

shown in (13): 
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((COMP comp) (NP. (Ivan)) 

(TENSE past) (INFL inll) (AUX1 be) (NFG1 negl) (NEG2 neg2) (AFFIX! ing) (13) 
(AUX2 nil) (AFFIX2 nil) (AUX3 nil) (Al l 1X3 nil) (VERB eat) 

(NP 2 (potatoes))) 

Suppose that the program GFN gets as input the following I ASK: 

TASK = ( (K 0 ) (N't Question) (.)) 


Fere, Ml is the notation for the contracted form of the negative transformation-, If simply inserts 
n't, the contracted form of not, as the 'alue of the element NBG1 of (he T$(K Q ). Question is the 
name of the question transformation. This transformation takes the three elements: TENSE, 
AUX1 and NEG1 in the Transformational Structure of a kernel sentence and moves them to the 
front of the structure. 


TS (K ), the altered Transformation Structure of TS(K 0 ) after undergoing these two 
transformations, is shown below in (14): 


i 


((TENSE past) (AUX1 be) (NEG1 n’t) (CQMP 
(INFL inO) (NEG2 neg2) (AFFIX! ing) 

(AUX2 nil) (AFFIX? nil) (AU.X3 nil) (AFFIX3 nil) (VERB eat) 
(NP 2 (potatoes))) 


(14) 


Now that all the transformations have been applied to JS(K 0 ) let us consider how certain 
AcljuMments work on the resulting T ransfarmalional Structure (14). 

(a) Garbage Deletion removes all the elements in the TS which have beep left unspecified at this 
point. It also rejects all elements whose value is n//. The result is: 

((TENSE past) (AUX1 be) (NFG1 n’t) (NP t 
FIXI |ng) (VERB pat) (NP (potatoes))) 


(b) Do D eletion deletes the auxiliary do when it immediately precedes a verb. But the 

s " T" • • •' ’ 

Transformational Structure is designed in such a way that the auxiliary do is inserted in the TS as a 
value of the AUX1 only when the original kernel sentence does not contain any other auxiliary 
verbs. There is no do in the Structure (14) since the auxiliary be is present, therefore the adjustment 
Do Deletion js pot applicable ip this example. 


(c) Affix HomiM takes every affix that is immediately followed by a verb (including TENSE, which 
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mentioned in Section 1 also carries the grammatical features of NP ) and attaches it to the verb so 
that the affix becomes part of it: 


((AUX1 was) (NEG1 n’t) (NP, (Ivan)) 
(VERB eating) (NP 2 (potatoes))) 


(d) _N 7 Hop ping lakes the element NECil of the Trt 
n't to the immediately preceding auxiliary verb. 


msformational Structure and attaches its value 


((AUX1 wasn’t) (NP, (Ivan)) (15) 

(VERB eating) (NP 2 (potatoes))) 


Now that all the adjustments have beet performed, the word string composed of the values of all 

the constituents of the Transformational Structure (15) produces the correct kernel sentence 
* . 

K - "Wasn’t Ivan eating potatoes": 

Thus, we have examined the following four Adjustments : 21 
1. Garbage Deletion 

■' '■ ■ 2. Do Deletion (16) 

3. Affix flopping 

4, N’t flopping 

We are going to show now that in order to build a system of Commutative transformations the 
following two constraints must be imposed: 

Separation Constraint '- Any adjustment in the list (16) should be executed only after all the 
transformations from the TASK have been applied. 


Ordering Constraint : The adjustments must be applied only in the order in which they are 
listed in (16). 


First, in order to prove the necessity of the Separation Constraint we need to show that none of the 
adjustments can be performed before a transformation. This can be shown by contradiction: we 
will demonstrate for each of the adjustments in (16) that the violation of the Separation Constraint 
prevents the application of certain transformations or leads to an infraction of commutativity. 


21. In the implemented system there are a few other adjustments, but for simplicity we will not discuss them here. 
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Finding one counterexample to evei> adjustment is sufficient for a proof because of the 
Commutativity of the system, f or clarity, we will consider the arguments in connection with either 
the kernel sentence "Ivan ate the carrot" and its corresponding Transformational Structure (17): 


((COMP comp) (NPj (Ivan)) 

(TENSE past) (INI I. infl) (AUX1 do) (NIX.il negl) (NEC2 neg2) (VERB eat) (17) 
(NP 2 (the carrot))) 


or with the kernel sentence "Ivan was eating the carrot" and its Transformational Structure (18): 


((COMP comp) (NPj (Ivan)) 

(TENSE past) (INFL infl) (AUX1 be) (NF.Gl negl) (NEG2 neg2) (AFFIXl ing) (18) 
(VERB eat) 

(NP 2 (the carrot))) 

1. Garbage Deletion cannot be performed before any transformation that uses the dummy elements 
in the Transformational Structure; for instance, Negation, or any transformation that constructs 
embedded clauses, This is because the elements required by such transformations would be deleted 
by the Garbage Deletion adjustment before these transformations could have been applied. 

2. Do Ddetion cannot be performed before the Question transformation. If it were, the auxiliary 
verb do which is necessary for the construction of the correct output of the Question transformation, 
"Did Ivan eat the carrot", will be prematurely deleted by the adjustment Do Deletion. 


3. Affix Hopping cannot be performed before any transformation that inserts a new verb or a new 
affix into the Transformational Structure. Suppose that the transformation Passive is to be applied 
to the Transformational Structure (18) of the kernel sentence "Ivan was eating the carrot." Among 
other effects this transformation inserts the verb be with the affix en in front of the main verb eat 
into the Transformational Structure (18) in order to obtain the past participle of the verb. 22 


((COMP comp) (NPj (The carrot)) 

(TENSE past) (INEE infl) (AUX1 be) (NF.Gl negl) (NEG2 neg2) (AFFIXl ing) 
(BE-PASS be) (F.N-PASS en) (VERB eat) 

(BY-PASS by) (NP 2 (Ivan))) 

If the adjustment Affix Hopping had been applied to the Transformational Structure (18) before the 


22 . 


The description of the Passive transformation can be found in Section 7, 
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Passive transformation, the affix mg would "hop" onto the wrong verb eat instead of the verb be. 
The affix en, inserted afterwards by the Passive transformation, could not "hop" on the verb eat. As 
a result, the system would not be able to output the expected sentence "The carrot was being eaten 

by Ivan." 


4 The adjustment /VV Ho pping also cannot precede certain transformations. Let us consider the 
T ransformational Structure IS for the sentence "Ivan ate the carrot aftci the two tiansfoimntions 
Question and N’t have been applied: 


((TENSE past) (AUX1 do) (NF.G1 n't) (COMP comp) (NP 1 (Ivan)) 
(INEL ind) (NEG2 neg-2) (VERB eat) 

(N \\ (the carrot))) 

/- 


If the adjustment N’t Hopping is now applied before the transformation Passive, the element lft will 
be prematurely attached to the auxiliary verb do . As a result, it will be impossible to execute the 
transformation Passive and transform the sentence " Didn t Ivan eat the can ot into the sentence 
" Wasn’t the carrot eaten by Ivan." 


We have shown that the adjustments are separated from the transformations. Now, to demonstrate 
that the Ordering Constraint is needed, we will again examine the sentence "Ivan ate the carrot and 
its Transformational Structure (17). We need to show that the adjustments must necessarily be 
ordered as stated in (16): 1. Garbage Deletion, 2. Do Deletion, 3. Affix Hopping, 4. N 11 lopping. 


1. Garbage Deletion differs from the other three adjustments in (16) because it does not employ the 
notion of adjacency required by all the other adjustments: Do Deletion deletes the auxiliary do 
when it immediately precedes a verb; Affix Hopping attaches the affix to the verb immediately , to its 
right; N’t Hopping attaches n 7 to the immediately preceding auxiliary verb. 

Prior to the adjustment Garbage Deletion, the adjacency condition necessary for the application of 
the other adjustments does not hold because of the presence of unspecified elements in the 
Transformational Structure. Garbage Deletion should be executed first because it eliminates these 
unspecified elements allowing the other adjustments to work. For example, Garbage Deletion 
removes the unspecified elements NEG 1 and NEG2 in; the Transformational Structure shown 
below, making it possible for Do Deletion to delete the auxiliary do since do and the main verb are 

now adjacent: 
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(TENSE past) (A UX1 do) (VERB eat) 

(NP 2 (the carrot))) 

It should also be noted that the adjustments Do Deletion , Affix Hopping , and N't Hopping do not 
introduce any dummy or unspecified elements in the TS which would otherwise have to be 
removed by the Garbage Deletion. 

2. Do Deletion must be performed before Affix Hopping. Otherwise, the value past of the TENSE 
would "hop” onto the verb do instead of eat, and after executing all the adjustments on the 
Transformational Structure (17) we would obtain the sentence "Ivan did eat Tie carrot" instead of 
"Ivan ate the carrot." 23 

3. The adjustment Affix Hopping cannot follow N't Hopping. To show this suppose that the 
transformation N't has been applied to the Transformational Structure (17). After the Garbage 
Deletion adjustment the TS will have the following form: 


(TENSE past) (AUX1 do) (NEG1 n’t) (VERB eat) 

(NP 2 (the carrot))) 

If now the adjustment N't Hopping is executed first, producing the new element don’t , the Affix 
Hopping adjustment will not be able to attach the T ENSE to the element don’t. This observation 

j 

completes the proof of the Ordering Constraint. 

Thus two different classes of operations on the Transformational Structure have been defined in 
this paper so far: the optional commutative Transformations and the obligatory, intrinsically 
ordered Adjustments. The Separation Constraint and the Ordering Constraint explain their mutual 
relations. 


§6. Connective Transformations 

In this section we will examine the Connective Transformations , a particular class of English 
transformations which arc used to construct sentences with Embedded Clauses. In order to form a 


23. The sentence "Fyan did eat the carrot" is, of course, fully grammatical. It is the emphatic form of the sentence "Ivan 
ale the carrot" used to stress a certain semantic message. In designing the system we decided not to allow such sentences 
so that all the adjustments would be obligatory. 
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sentence of this type the system needs two kernel phrase markers as input: K Q - which plays the role 
of matrix clause and K - which is used as the basis for the embedded clause. The word it will be 
used as a joining point. The kernel sentence K Q must contain the word U, in tnc role ol eithei agent 
or theme. A Connective Transformation when applied to the kernel sentence K t is said to produce 

the altered kernel K* in the form appropriate for an embedded clause. Other transformations 

(if any) change the kernel K 0 into K*. Then, a special procedure combines the two altered kernel 

sentences by substituting the kernel K for the joining point jj in the kernel K y 


As an example of the procedure just dc cribed, consider the following kernel sentences: 

K = It bothers Maria 
K — Ivan has ignored that letter 

The embedded clause has the Transformational Structure below: 

((COMP comp) (NPj (Ivan)) 

(TENSE present) (INF!, infl) (AUX1 have) (NB.Gl ncgl) (NBG2 neg2) (AFFIX1 cn) 


(19) 


( 20 ) 


(VERB ignore) (NP (that letter))) 


Now suppose that one of the Connective Transformations, FOR-NP^TOj, is to be applied. This 
transformation produces a /tWo-complemcnt clause by inserting FOR and TO as the values of the 
elements COMP and INFL, respectively, in the Transformational Structure (20). The result is: 


((C'OMP For) (NPj (Ivan)) 

(TENSE present) (INFL to) (AUX1 have) (NEG1 ncgl) (NHG2 neg2) (AH-1X1 en) 

(VERB ignore) (NP 2 (that letter))) 

Then the transformed kernel sentence Kj = "For Ivan to have ignored that letter is substituted 
for the word it in the kernel K fi = "It bothers Maria" producing the sentence: "For Ivan to have 
ignored that letter bothers Maria" as the result. 


The Connective Transformations form a family of transformations defined by three parameters, 
each referring to a position in the 1 ransformational Structure of the embedded clause, the 
complementizer COMP, the first noun phrase NP } and the complementizer INFL. 

The parameter COMP indicates the affix which introduces the embedded clause. It can receive one 
of the following four values: {POSS, THAT, FOR, 0}. The affix POSS actually "hops" onto the 
following noun during the Affix Hopping adjustment to form a possessive noun phrase. THAT and 
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FOR are "independent" words and do not hop to the right like other affixes. 0 means that there is 
no overt affix in this position. 

' die parameter NP takes on one of two values: {NP r 0} indicating whether or not the first noun 

phrase of the embedded clause is present in the resulting sentence. 

"he parameter INFL may also be considered an affix specifying how the verb in the embedded 
(lause should be inflected, It can have one of four values: {INC, INF, TO, 0}. As in the case of 
POSS, the value INC is the only "real" affix which hops onto the following verb producing the 
I regressive form. The value INF indicates that the following verb is in the infinitive form, TO is 
; n independent word which produces Tie TO + infinitive form of the verb. 0 signals that no affix 
is present, so the verb remains inflected for person, number and tense. 

A particular set of values for the three parameters COMP, NPj, and INFL is sufficient to determine 
tne form of the embedded clause completely (although not every possible triple produces a 
grammatical English clause). Hence the commutative transformation which generates the 
embedded clause is also uniquely determined. Therefore, we will use the values of these three 
parameters to form the names for the Connective Transformations. Each name is represented as a 
triple consisting of the current values of the parameters COMP, NP ( and INFL with the following 
structure: COMP-NPjTNFL. We have already seen some examples of such names: O-NP^TO, 
THAT-NP^O, FOR-NPj-TO, etc. 

The adjustment Affix Hopping deletes the element TENSE in the Transformational Structure 
unless the value of the parameter INFL is 0, Consequently, most of the Connective 
Transformations construct tenseless clauses. The exceptions are the transformations THAT-NP^O 
and 0-NP -0. To give examples with tensed embedded clauses let us consider now another kernel 
sentence for the matrix clause: K Q = "Maria knows it." After combining the altered kernels, the 
program outputs the following sentences: 

1. After THAT-NPj-Oj: Maria knows that Ivan has ignored that letter 


2. After O-NPj-Op 


Maria knows Ivan lias ignored that letter 


'The transformations THAT-NP^O and O-Nf^-O also differ from the transformations which 
produce tenseless clauses in their treatment of negative elements in the Transformational Structure. 

A general description of the action of a Connective Transformation can be stated as follows: 

(a) Current values of the parameters COMP and INFL from the name of the transformation 
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are inserted in the Transformational Structure. 

(b) If the value of the parameter NP is 0. the element NP } is removed from the Structure. 

(c) If the value of INFl. is not 0, two negative elements, NEG1 and NEG2, are moved front 
their usual position after the first auxiliary veil) and placed in the front of TENSE. We will 
call this phenomenon Neg Jump. 


When the value of the parameter NP is 0. the first noun phrase in the matrix clause must be 
coreferential with the first noun phrase in the embedded clause. As an example, consider the pair 


of kernel sentences: 


K = Ivan wanted it 
K = Ivan kissed Maria 


Suppose that the transformation 0-0-TO applies. This transformation inserts the required values of 
COMP and INFL into the Transformational Structure for the kernel sentence and deletes the 


element NP in the Structure: 


((COMP 0) (NPj 0) (NEG1 negl) (NEG2 neg2) 

G- (TENSE past) (INFL to) (AUX1 do) 

(VERB kiss) (NP 2 (Maria))) 

After all the adjustments have been performed and the altered kernels have been combined the 
program will output: "Ivan wanted to kiss Maria." 


in the example above Neg Jump takes place only vacuously because the unspecified elements 
NEGl and NFIG2 are removed front the Transformational Structure. It is also difficult to see this 
phenomenon if the kernel sentence K does not have any auxiliary verbs because after the Garbage 
Deletion adjustment nothing will be left in the TS for NEG to jump over. This phenomenon can be 
observed in a sentence in which the negative transformation Not also applies. The following TASK 
provides us with the appropriate examples: 


TASK =((K 0 K x ) ( That-np l -0 1 Not l For-nppto^ Poss-np^ing t ) (.)) 

Here K and K ; are the kernel sentences from (19): 

K q = It bothers Maria (19) 

K = Ivan has ignored that letter 

Neg Jump can be observed by comparing either sentences #2 with #3 or sentences #2 with #4 
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in (21): 


1. AftorTlIAT-NP -0 : 


1 


3. Alter 1 OR NT',- 10.: 


That Ivan has ignored that letter bothers Marla 
That Ivan has not ignored that letter bothers Malta 
For Ivan no| to have ignored that letter bothers Maria 


4. After POSS-NP.-ING,: Ivan’s not having ignored that letter bothers Maria. 

The system contains a family of ten different Connective Transformations used to construct 
sentences with various embedded clauses. An example of the application of each of 
transformations is given in the table b< 

TABLE! 


Transformation 

Matrix Clause 

Cmbeilded Clause 

Sentence 


THAT-NPj-0 

THAT-NPj-INP 

O-NiyiNT 

It bothers Maria 

Maria suggests it 

Maria watched it 

Ivan ignored the letter 

Ivan is silent 

Ivan washed the dishes 

That Ivan i| 

Maria sugge 

Maria watcl 

mored the letter bothers Mari 

;sts that Ivan be silent 

icd Ivan wash the dishes 

O-NP.-O 

[■OR-NiyfO 

o-Nif-ro 

\ 

Maria knows it 

It amuses Maria 

\ 

Ivan has ignored that letter 
Ivan ignored the letter 

Maria know 

For Ivan to 

<s Ivan has ignored that letter 
ignore the letter amuses Mari 

Maria asked it 

1 van ate the cake 

Maria askcc 

! I van to eat the cake 

I 

O-O-TO 

fvan claims it 

Ivan has written that letter 

Ivan claims 

to have written that tetter 

POSS-NP.-iNG 

It shocked Maria 

Ivaft ignored the letter 

Ivan’s ignor 

tug the letter shocked Maria 

i 

o-MytNG 

0-0-f KG 

Maria saw it 

(van ate the cake 

Maria saw 1 

van eating the cake 

It atttuses Maria 

Maria watches movies 

Watching it 

levies amuses Maria 


ta 


ta 


The main verb of the matrix clause determines which clause may be embedded under it ar . 
therefore,- the kind of Connective Transformation that may be applied in each particular case, 
Cottseefuemfy, any computer implementation of the Language Generation Procedure must contain 
a list of permissible transformations for every verb that can appear in a matrix 


The system prevents the generation of the ill-formed sentences by employing transformational 
filters , a third cites of operations on the Transformational Structures which not only signal that a 
certain combination of the transformations will result in att ungrammatical sentence, but also, if 
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possible, suggest additional rules in order to correct the output. 74 Although this paper will not 
consider such rules in detail, here are several illustrative examples: 

(a) If the transformations THAT-NP^ and PASSIVE have been applied to kerne! sentences K Q 
and K from (19), the resulting sentence obtained after combining the altered kernels is ill-formed: 
* "Maria is bothered by that Ivan has ignored that letter." The transformational filter rejects the 
i ngrammatical construction prep-THAT-clause anti suggests that the words 'the fact be inserted 
h the Transformational Structure of the embedded clause. Then, after all the Adjustments have 
been applied, the system outputs the correct sentence: "Maria is bothered by the fact that Ivan has 
ignored that letter." 25 


(b) If the transformations O-NP-TO and PASSIVE are to be performed on the kernels K 


o 

"Maria forced it" and K = "Ivan peeled potatoes”, the program has to combine the altered kernel 

|. = "it was forced by Maria" with the altered kernel = "Ivan to peel potatoes. The 

transformational filter rejects the resulting sentence: * "Ivan to peel potatoes was forced by Maria" 
as ungrammatical. Then, taking into account the semantic dnss of the main verb force, the filter 
proposes to "raise" the first noun phrase of the embedded clause Ivan to the position of the first 
noun phrase in the matrix clause //; the rest of the embedded clause moves to the end of the matrix 
clause. Now the resulting sentence is correct: "Ivan was forced by Maria to peel potatoes." 


(c) If the embedded clause is very long, the transformational filter suggests applying the 
Extraposition rule, a rule which shifts the embedded clause to the end of the matrix clause leaving 
the word "it" in its original position in the matrix clause. Thus, the sentence #1 from (21) can be 
changed to "It bothers Maria that Ivan has ignored that letter." 26 

A family of ten transformations for generating embedded clauses was introduced in this section. 
This family is completely defined by the values of three parameters COMP, NP r and INFL and, 
therefore, can be considered as a single Connective Transformation whose surface manifestation has 
several different forms depending on the values of these parameters. 


24. In contrast with the usual transformations, which operate within a kernel sentence, one can analyze transformational 
filters ns imerkernel transformations because they may operate across the kernels. 

25. The noun "fact" is one of the so-called factive nouns which include also words like "idea”, "report", etc. 


26. We leave aside for now the question of defining "length". Notice, that the Extraposition rule may also apply to short 
embedded clauses: "ll bothers Maria that Ivan left.” ^ , 
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§7. Other Transformations 


In this section we will add three new transformations to the system of Commutative 
Transformations-. T p = Passive, T = Dative Movement , and T n = There Insertion. The 


definitions of these transformations refer to the noun phrase positions in the Transformational 


Structure: NP. 


NP NP and to their «exical and semantic values. 


Definition: 

Passive is a transformation that 

(a) Permutes to the left the values of th ree noun phrases NP , NP , and NP 2 

T i 

NP. <— NP, 5 <*—NP ? 

(b) Inserts the verb be after the affix of the last auxiliary verb or, if AUX1 = do, substitutes 
the verb he for the auxiliary do 

(c) Inserts the affix, em in front of the main verb 

(d) Inserts the preposition bv in front of NP 2 27 

Consider the kernel sentenee K = "Ivan gave Marla the bottle" with the Transformational 

* 

Structure (22): 


((COMP comp) (NP, (Ivan)) 

(TENSE past) (INFL in 11) (AUX1 do) (NEG1 negl) (NEQ2 neg2) (22) 

(VERB give) (NP 15 (Maria)) (NP, (the bottle))) 


The Passive transformation alters the kernel sentence K 




bottle" into the 


sentence T P (K) * "Maria was given the bottle by Ivan" by changing the Transformational 
Structure (22) into: 


((COMP comp) (NP, (Maria)) 

(TENSE past) (INFE infl) (AUX1 he) (NEQ1 negl) (NEQ2 neg2) (23) 

(EN-PASS en) (VERB give) (NP U (the bottle)) (BY-PASS by) (NP 2 (Ivan))) 




27 , In this definition, when referring to the words be, en, and by we mean elements (BE-PASS be), (EN-PASS en), and 
(BY-PASS by) in thelranslbrmiUiomil Structure. 
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In the case when there are only two noun phrases in the input kernel sentence, to permute two 
NP's means the same as to i n torch an ae them. In this case our definition comes closer to the 

conventional definition of Passive. „ . 

The transformation Dative Movement chane.es the kernel sentence k. — ,van gave Maiia the 
bottle" into the sentence T 1)M (K) = "Ivan gave the bottle to Maria. A possibl 3 definition of Dative 
Movement could refer to the syntactic constituents NP ]5 and Nib, in t ie Transformational 

Structure: 

(a) Interchange the values of NP ] 5 and NP 2 

(b) Insert the word to in front of NP 2 

This definition of Dative Movement when applied to the kernel K gives the desired result 1 2 (K) — 
"Ivan gave the bottle to Maria." Suppose, however, that the Passive transformation is to be applied 
to the kernel K prior to Dative Movement producing the Transformational Structure (23) 
corresponding to the sentence T p (K) = "Maria was given the bottle by Ivan." If Dative Movement 
(as it is defined above) is now applied to T p (K), the Transformational Structure will be transformed 

into: 

((COMP comp) (NPj (Maria)) 

(TENSE past) (1NFL infl) (AUX1 be) (NEG1 negl) (NEG2 neg2) 

(EN-PASS en) (VERB give) (NP 1S (Ivan)) (BY-PASS by) (DAT to) (NP 2 (the bottle))) 

The resulting sentence 1 UM (T p (K)) is unacceptable: * "Maria was given Ivan by to the bottle." 

In order to obtain the correct result we need a different definition of Dative Movement which lefers 
not to NP-positions in the Transformational Structure, but rather to semantic values of the noun 
phrases which indicate the role that the noun phrase plays in the sentence: agent, goal, or theme. 

In this paper several transformations which operate on the Transformational Structure of a kernel 
phrase marker have been examined: the Question Transformation, Negation (full and contracted), 
Passive , and the Connective Transformation. All of these transformations are defined in puiely 
syntactical terms: they move, insert, or delete syntactic constituents in the Transformational 
Structure. So far, we have seen semantic notions used only in the "decision-making" procedures. 
For instance, the system needs the semantic class of the main verb in the matrix clause to determine 
which of the Connective Transformations may be applied and what rule should combine the altered 

kernel sentences. 







Katz 


- 27 - 


Other I rans fortnations 


Dative Movement is the only transformation in our system that is defined in semantical terms. 


Definition: 


Dative Movement is a transformation that 


(a) Interchanges the noun phrase which plays the role of goal with the noun phrase which 
plays the role of theme 

(b) Depending on the main verb, assigns one of two values {TO. FOR} to the element DAT 
which will later be inserted in front of the goal noun phrase in the TS b\ a special adjustment 


DAT Insertion 

The result of this transformation is that the goal noun phrase will be in th: position previously 
occupied by theme noun phrase and the theme NP will be in the position occupied by goal NP. 

For instance, the Dative Movement transforms the Transformational Structure (22) of the kernel 
sentence K = "Ivan gave Maria the bottle" into: 

((COMP comp) (NPj (Ivan)) 

(TENSE past) (INFL infl) (AUX1 do) (NEG1 negl) (NEG2 neg2) (24) 

(VERB give) (NP 15 (the bottle)) (NP 2 (Maria))) 

Then the adjustment DAT Insertion inserts the element (DAT to) into the Transformational 
Structure (24) resulting in (25): 

((COMP comp) (NPj (Ivan)) 

(TENSE past) (INFL infl) (AUX1 do) (NF.G1 negl) (NEG2 neg2) (25) 

(VERB give) (NP 15 (the bottle)) (DAT to) (NP 2 (Maria))) 

After all the other adjustments have been performed the system outputs the correct sentence "Ivan 
gave the bottle to Maria ." 28 

Not only do we obtain the correct results by applying each of two transformations Passive and 
Dative Movement to the TS of the kernel sentence, but also, our definitions are so formulated that 
these transformations can be applied in any order. Dative Movement can be applied to the 
Transformational Structure altered by Passive and vice versa. 


28. In the usual analysis (see, for instance, [Akmajian and Heny 1975}) Dative Movement transforms the sentence "Ivan 
gave the bottle to Maria" Into the sentence "Ivan gave Maria the bottle.” 
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I el us. for example, apply Dative Movement to tlie IS in (23) altered by the Passive transformation. 
The noun phrase "Maria" which plays the role of goal is interchanged with the noun phrase "the 
bottle" which plays the role of theme. Then, the DAT Insertion adjustment inserts the preposition 
to in front of the goal noun phrase "Mai ia" producing the TS (26): 

((COMP comp) (NPj (the bottle.) 

(TENSE past) (INEL infl) (AUXl he) (NEG1 negl) (NEG2 neg2) (26) 

(EN-PASS en) (VERB give) (DAT to) (NP )5 (Maria)) (BY-PASS by) (NP 2 (Ivan))) 

Tiie resulting sentence is T DM (T p (K)) = "The bottle was given to Maria by Ivan. The 
Transformational Structure (26) can also be obtained if the transformation Passive is applied to the 
IS (24) (that is, after Dative Movement has been applied). 

The following diagram (27) illustrates the commutativity of these transformations: 


Dative Movement 


K = Ivan gave Maria the bottle 


> 


T um< K > 


Ivan gave the bottle to Maria 


Passive | 

I 

; I 

4- Dative Movement 

T (K) = Maria was given the bottle by Ivan .> 

s ■ ■ 

The final transformation to be considered is There Insertion, defined below. 
Definition: 

There Insertion is a transformation that 

(a) Substitutes the word there 119 for the the NP^position in the TS 

29. More precisely, the element (Ti l there) of the Transformational Structure. 


Passive (27) 


4 - 

The bottle was given to Maria by Ivan 
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(b) Moves the NP -position in front of the affix associated with 
verb be in the Transformational Structure 


tost occurrence 


As an example, consider the kernel sentence K = "A boy was eating a cake" with the 
Transformational Structure (28): 


((COMP comp) (NP, (a boy)) 

(TENSE past) (1NFL inn) (AUX1 lie) (NEGl negl) (NEC2 neg2) (AFFIX! ing) (28) 
(VERB eat) (NP 2 (a cake))) 

1 here is only one verb be in the TS above, therefore, AFF1X1 is the required affix. After applying 
the transformation There Insertion the Transformational Structure (28) will be transformed to (29): 

((COMP comp) (Til there) 

(TENSE past) (INFL infi) (AUX1 he) (NEG1 negl) (NEG2 neg2) (29) 

(NPj (a boy)) (AFFIX1 ing) (VERB eat) (NP 2 (a cake))) 

The corresponding English output is "There was a boy eating a cake." 

Suppose, however, that Passive was applied to the Transformational Structure (28) causing another 
verb be to be inserted after AFFIX1: 


((COMP comp) (NPj (a cake)) 

(TENSE past) (INFL inti) (AUX1 he) (NEG1 negl) (NEG2 neg2) (AFF1X1 ing) (30) 
(BE-PASS be) (EN-PASS en) (VERB eat) (BY-PASS by) (NP 2 (a boy))) 

Here the leftmost occurrence of be in the Structure (30) is the one referred to in the definition of the 
transformation There Insertion and the position of the first noun phrase is moved in front of its 
affix: 

((COMP comp) (TH there) (TENSE past) (INFL infl) 

(AUX1 be) (NEG1 negl) (NEG2 neg2) (NPj (a cake)) (AFF1X1 ing) (31) 

(BE-PASS be) (EN-PASS en) (VERB eat) (BY-PASS by) (NP 2 (ahoy))) 

The Transformational Structure (31) produces the sentence: "There was a cake being eaten by a 
boy." 


Consider now the question of the commutativity of the three transformations introduced in this 
section. It follows front the definitions that There Insertion does not change the original disposition 
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cl'the noun phrases NP NP and NIP in the Transformational Structure. Therefore, since There 

■■ ". .' ; - ' j J .3 *■ . . .. . •• 

Insertion does not interfere with the action of Passive and Dativ e M ove men t., it does not prevent 
these transformations from permuting or interchanging the noun phrases. It is thus possible to 
apply the Passive transformation and Dative Movement after There Insertion. On the other hand, 
Dative Movement and Passive may freely interchange the noun phrases in the TS because it makes 
no difference to the transformation There Insertion which of the noun phrases is located in the 
MP -position. 30 There Insertion , therefore, can be applied after Passive and Dative Movement. 
Since we have shown that There Insertion may precede or follow Passive and Dative Movement, and 
tiiat the transformations Passive and Dative Movement are commutative, it follows that all three 
transformations introduced in this section are commutative. 


d he application of There Insertion is restricted to sentences with an indefinite noun phrase in the 
!\P position, but the transformations Passive and Dative Movement interchange the noun phrases 
in the Transformational Structure. We, therefore, need a sentence with three indefinite noun 
phrases to provide an appropriate example for showing the commutativity of the transformations. 
In this case the result of application of There Insertion would be grammatical regardless Of the order 
of the transformations. Suppose that K = "A man was reading a boy some interesting stories." If 
the three transformations are applied in the order: 1. There Insertion, 2. Passive, 3. Dative 
Movement, the result is: 


1. After There Insertion: There was a man reading a boy some interesting stories. 

2. After Passive: There was a boy being read some interesting stories by a man. 

3. After Dative Movement: There were some interesting stories being read to a boy by a man. 

The reverse order of the transformations: 1. Dative Movement, 2. Passive, 3. There Insertion 
produces the following sentences: 

1. After Dative Movement: A man was reading some interesting stories to a boy. 

2. After Passive: Some interesting stories were being read to a boy by a man. 

3. After There Insertion: There were some interesting stories being read to a boy by a man. 

|_ | || - JT -- r -j------|-----WPWWMWMMW.. ■ ■—.. . 

30. There Insertion merely moves the Nl^-position in the Transformational Structure to the right. 

31. We will not give here examples of all possible permutations of these transformations because the commutativity of 
Passive and Dative Movement has been already shown before. 
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this section has introduced three additional transformations that refer to noun phrase positions and 
their values.The Passive transformation refers to the positions NP,, NP 5 , and NP, permuting 
their values. Dative Movement refers to the semantic values goal and theme and interchanges the 
corresponding NP-positions. There Insertion moves the NReposition in the Transformational 
Structure. 


Step Three of the Language Generation Procedure uses the constructed system of optional 
commutative Transformations, the set o'conditionally obligatory Transformational Filters, and the 


set of ordered obligatory Adjustments to "solve" the TASK provided by Step One and Step Two 
at d to produce the corresponding English text. 


32. The system contains other transformations, 
they will not be discussed here. 


such as the Relative transformation, Imperative and Tag Question, but 
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APPENDIX 1: Pronominalization 

The program GEN which implements Step Three of the Language Generation Procedure "reads" 
the input TASK supplied by Step One and Step Two of the LGP and generates the appropriate 
word string. Each element of the T ASK consists of a list of kernel phi; sc maikcis, a list of 
transformations, and a syntactic separator. There is a one-to-one correspondence between each 
TASK element and each English sentence in the output. Every noun phrase in a generated 
sentence derives its lexical value from one of the prepositionless noun frames, NF' 1 ", NF eoai , or 
NF' h, ' me , of the Semantic Frame Structure. Transformations may interchange the values of noun 
phrases, but the actual word string is never altered - , it can only be tiansfeired into another 
In 1 P-position in the Transformational Stiucture. Therefore, if different phrase markers of the TASK 
refer to the same noun frame, each instance ol the corresponding noun phrase would have the same 

lexical value. 

This repetition is awkward and in order to make the text more fluent, t.ie system tequires a 
pronominalization procedure which substitutes the repeated noun phrase with an appropriate 
pronoun. I he choice of the pronoun is determined by two parameters, the number and gender of 
the corresponding noun phrase. The values of these two parameters can be computed from the 
number and gender of the nouns which are heads of the noun phiases and the conjunctions that 

connect them. 33 

The pronominalization procedure is activated every time the system leads the next element of the 
TASK and generates the corresponding English sentence. In order to decide which noun phrase 
should be pronominalized, two subsequent sentences, referred to by the names current and 

previous, are examined. 

Definitions. 

CurmU-bl P-lisl is a list of all noun phrases in the last generated ( current ) sentence. 

Previous-NP-list is a list of noun phrases in the previous sentence. 

Previous-pronouns-list (PPI ) is a list of pronouns corresponding to each element of the previous- NP-list. 


33. In this paper we will not describe the rules that the system uses to calculate the number and gender of a given noun 
phrase. For instance, the number of the noun phrase "Ivan and Maria" is "plural’, the gender is lndilteienl, ■ Or, in Uie 
case of another noun phrase, "the man with a red tie", the number is "singular , the gender is masculine . Sirnila u e 

can be {bund in [Katz 1978]. 

34. All die pronouns contained in the previous- pronouns-list are in the nominative case. But aftei tlie decision to 
pronoininalize a noun phrase has been made, the appropriate lexical form of a pronoun (nominative, objective, or 
possessive) is chosen depending on the case of the corresponding noun phrase. 
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Suppose, for example, that the following two sentences were generated by the system: 

"Maria suspects that Tania is writing a letter to Ivan; Tania loves Ivan." (32) 

)n this example we have: 

current-NP-list = (( Tania) (Ivan)) 

previoUs-tiP-list = ((Maria) (Tania) (a letter) (Ivan)) 
previous-pronouns-list = ((she) (she) (it) (he)) 

Kvery noun phrase in the current-NP-list which is also present in the previous-NP-1isf is a possible 
candidate for pronominalization. But the decision to pronominalize each noun phrase is made only 
after comparing the pronoun that corresponds to the noun phrase under consideration with all the 
other elements of the PPL. 

Pronominalization Pule: A repetitive noun phrase in the current sentence is replaced by its 
pronoun only if the pronoun is unique in the previous-pmnouns-list (that is, no other noun 
phrases in the previous sentence lias the same pronoun). 

in the example (32) the program will not substitute the pronoun "she" for the noun phrase "Tania" 
because this pronoun is not unique in the PPL. The Pronominalization Rule helps the system avoid 
ambiguity that arises when this substitution is made: "Maria suspects that Tania is writing a letter to 

Ivan. She loves fvan." 

Oh the other hand' since there is only one occurrence of "he" in the PPL, the noun phrase "fvan" 
can be pfOnominaiized, resulting in: "Maria suspects that Tania is writing a fetter to Ivan. Tania 

loves him;" 35 

The Prdnoiriinafization Rule, however, is a necessary but not a sufficient Condition for the 
p'roironiihaTization procedure, in sohYe cases complementary heuristic rules must be employed in 
order to rtiake the llnal decision. 


35. ft should be noted that more than one pronoun is possible in a sentence as long as the Pronominalization Rule is not 
violated. The example is: "Many people suspect that Tania is writing a letter to Ivan. She loves him." 
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APPENDIX 2: The Parser 


This section describes the parser, a program that processes kernel sentences and builds the 
corresponding Semantic Frame Structures using the three types of templates defined in Section 1 of 
this paper: 


noun-template (NT) = (prep drt adj noun) 
verb-template (VT) = (tense auT aux2 aux3 verb) 
adverb-template (AT) = (mod adverb) 


(34) 


Each word in the kernel sentence is always associated with a unique part of speech, 36 and, therefore, 
with a unique position inside one of the templates NT, VT, or AT. We will assume that a kernel 
sentence can be represented by the following sequence of frames: 37 


^pinitial pj pagein yp fsjpgoal pj plhomc pjp 


final 


(35) 


Each constituent in (35) can be obtained by applying the two operations Concatenation (CONC) 
and Conjunction (CONJ) 38 to the templates NT, VT, or AT in (34). All constituents are optional; 
for example, the presence of the frames NF 80al and NF lhcmc depends on the type of main verb in 
the kernel sentence (transitive, intransitive, or double-transitive). ' 


The parser analyses every word in the input kernel sentence, scanning it from left to right and 
mapping the appropriate pieces of the word string onto the corresponding templates. The parser 
then decides which of the templates should be concatenated or conjoined in order to form the 
necessary noun-frame, verb-frame, or adverb-frame. Because each word in the sentence is 
associated with a unique template, the parser starts to create the appropriate type of template 
("opens" the template) after examining the very first word in the sentence. The template must be 
filled out from left to right. If any element in the template is left unspecified, the parser inserts nil 
as the value of this element. When all the elements of the template are filled out, the parser 
"closes" the template. Then, depending on the next word and its position in the sentence, the 
parser has two choices: 


36. The question of lexical ambiguity, that is the case when one word can serve as various parts of speech, is not discussed 


in this paper. 

37. For simplicity, the adverb frames AF' niiial , 

38. These operations are defined in Section 1. 


Apmcdiai, anc j AF final are not shown here. 
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(a) it either continues the construction of the frame, starting to create another instance of a 
template of the same type, or 

(b) it "closes" the current frame and begins to fill out the elements of another template, 
thereby starting a new frame. 

Here is an example to clarify the procedure. Suppose that the paisei takes the following sentence as 


input: 


In the evening a young tall man with blue eyes gave Maria a beautiful book and a lose. (36) 


triggered by the preposition "in", the parser begins the constiuction of the noun-frame NF by 
tilling out the noun-template as follows, ((prep in) (det the) (adj nil) (noun evening)). The next 
word in the sentence is the determiner "a", which indicates the absence of a preposition in the next 
noun-template, and, therefore, suggests that the frame (NF mmal ((prep in) (det the) (adj ml) 
(noun evening))) should be closed and that the construction of a new prepositionless noun-frame 
NF ascm should begin. This frame consists of the concatenation of two noun-templates: 

(NF agcnt ((prep nil) (det a) (adj (young tall)) (noun man) 

(prep with) (det nil) (idj blue) (noun eyes))) 

There is no auxiliary verbs in the sentence (36), and hence the parser builds from the verb gave 
the following verb-frame (VF ((tense past) (auxl nil) (aux2 nil) (aux3 nil) (verb give))) with 
the unspecified auxiliary elements. Then, the word "Maria forms another noun-fiame (NF 
((prep nil) (det nil) (adj nil) (noun Maria))). Finally, the parser uses the operation Conjunction 
to construct the last prepositionless noun-frame NF lht,Tie from two noun-templates. 

(Npiheme (( pre p nil) (det a) (adj beautiful) (noun book) (conj and) 

(prep nil) (det a) (adj nil) (noun rose))) 

The Semantic Frame Structure (37) below is the output of the parser after processing the 
sentence(36): 
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((NF" 11 "'' 1 ((prep in) (clet the) (aclj nil) (noun evening))) 

(N F agent ((prep nil) (del a) (adj (young tall)) (noun man) 

(prep with) (det nil) (adj blue) (noun eyes))) 

(VF ((tense past) (auxl nil) (aux2 nil) (aux3 nil) (verb give))) (37) 

(NF 80al ((prep nil) (det nil) (adj nil) (noun Maria))) 

(NF lhcmc ((prep nil) (det a) (adj beautiful) (noun book) (conj and) 

(prep nil) (det a) (adj nil) (noun rose)))) 

Let us consider now the problem of closure that arises in two different contexts in the parsing 
process: the closure of a template and the closure of a frame. 

A template is closed after a certain word if: 

(a) The next word belongs to a template of another type. 

(b) The next word belongs to the same type of template, but corresponds to a template 
element located to the left of the template element filled hist. 39 

Suppose now that a template has just been closed. The closure of a template implies the closure of 
a frame if: 

(a) The next word belongs to a template of another type. (The parser will then start to create 
a frame of the new type). 

(b) The next word is an element of a noun-template 40 but it is not a preposition. (The parser 
starts to construct a new prepositionless noun-frame). 

If these conditions are not satisfied, the parser continues the construction of the corresponding 
frame using, depending on the next word, one of the operations Concatenation or Conjunction. 
The rules above allow the parser to open and close all the frames in the kernel phrase marker (35), 
except the last one, NF n,ial . The system does not have a syntactic rule which can determine, when 
the prepositionless noun-frame NF ,herac ends and NF final begins. What, for example, should 
happen in the sentence: "Ivan saw Maria with the binoculars"? One possible reading of this 


39. Remember that a template must be filled out from left to right. 

40. We assume here that the previous template was also a noun-tern pi ate; otherwise, the condition a. holds. 
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sentence, where the parser closes the frame NF ,thl " K and opens 
with has been encountered, is represented below in the Semantic 
that Ivan was watching Maria through his binoculars: 


NF rmal as soon as the preposition 
Frame Structure (38). It suggests 


•ep n 


aoi n 


st) (aux I nil) (aux2 r 


(NF th ‘ ine ((prep nil) (det nil) (ad] nil) (noun Maria))) 

(NF :1mil ((prep with) (det the) (adj nil) (noun binoculars)))) 

/mother reading of the sentence "(van saw Maria with the binoculars ;s represented by the 
Semantic Frame Structure (39). In this case the parser uses the operation Concatenation to 
continue the construction of the noun-frame NF ,hemc after finding the preposition with. This 
reading suggests that Maria had the binoculars at the time when Ivan saw her: 


((NF agent ((prep nil) (det nil) (adj nil) (noun Ivan))) 


(VF ((tense past) (aux 1 nil) (aux: 

(NF thcme ((prep nil) (det nil) (adj nil) 
(prep with) (det the) (adj ni 


>1 U k 


(39) 


il) (noun binoculars)))) 


The problem of attaching the last prepositional phrase (PP finrJ Attachment) requires the use 


sem 


antic/syntactic interaction for its resolution [Marcus 1979] and will not be discussed here. 


The parser described here is restricted to processing the kernel sentences of the general form (35). 
However, more complicated sentences with several clauses can also be analyzed by the parser if a 
mechanism that splits the sentence into kernels is provided. As an example, considei the sentences 
with embedded clauses generated by the language Generation Procedure with the help of the 
Connective Transformations (see Table 1 in Section 6). The use of simple heuristic procedures (for 
example, counting the number of verbs and noun phrases, or searching for certain values of the 
complementizers COMP and I NFL) appears to be sufficient for reconstructing the kernels (matrix 
clause and embedded clause) which form every complex sentence in Table 1. For instance, the 


41. At this point, the parser makes the decision based on a list of prepositions which "usually" begin a new noun-frame 
(i.e. through ). 
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sentence "Ivan claims to have written that letter" consists of two clauses; Ivan claims it and Ivan 
lias written that letter", which have been combined by the transformation 0-0-TO. The possibility 
to reconstruct the kernels allows the parser to process any sentence generated by the Connective 
Transformations. 

Suppose that the input to the parser consists of several connected sentences ;a coherent text), and 
that a pronominalization procedure had been employed by the writer in older to make the text 
more fluent. If this procedure had been accomplished obeying the Pronominalization Rule stated in 
Appendix 1, the parser can easily resolve the anaphor , i.e. restore the noun phrases which were 
replaced by the pronouns. 

This parser has been used as a front end for Winston’s learning system [Winston 1980], It tianslates 
English descriptions of situations into descriptions in the extensible-relation representation. This 
representation was suggested by Winston and is implemented in his learning system using a version 
of Frame Representation Language [Roberts and Goldstein 1977], In FRL, an agent-act-theme 
combination is expressed as a frame , a slot in the frame, and a value in the slot. In the 
extensible-relation representation, a supplementary description node for an agent-act-theme 
combination is expressed as a comment frame attached to the frame-slot-value combination. 


Suppose, for example, that the following English text is the input to the parser: 

In the beginning of the story Duncan was a king. Macbeth was a happy 
noble. He married lady-Macbeth. She was a greedy and ambitious 
woman. She wanted Macbeth to be king. He also desired to be the king. 
Lady-Macbeth persuaded him to murder Duncan. Soon Lady-Macbeth 
decided to kill herself. Macduff was a loyal noble. He became angry. 
Macbeth’s murder of Duncan caused him to kill Macbeth. 


Below follow the frames which were generated after parsing the input text. Here, AKO stands for 
A-KIND-OF, and HP - for HAS-PROPERTY relations. 

(DUNCAN (ako (KING))) 

(MACBETH (ako (NOBLE) (KING (ako-1))) 

(hp (HAPPY)) 

(marry (LADY-MACBETH)) 

(desire (ako-1)) 

(murder (DUNCAN (murder-1)))) 
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(LADY-MACBETH (ako (WOMAN)) 

(hp (GREEDY) (AMBITIOUS)) 
(want (ako-1)) 

(persuade (murder-1)) 

(kill (LADY-MACBETH (kill-1))) 
(decide (kill- 1 ))) 

(MACDUFF (ako (NOBLE)) 

(hp (LOYAL) (ANGRY)) 
tkili (MACBETH (kill-2)))) 

(AKO-1 (frame (MACBETH)) 

(slot (AKO)) 

(value (KING))) 

(MURDER-1 (frame (MACBETH)) 

(slot (MURDER)) 

(value (DUNCAN)) 

(cause (KILL-2))) 

(KILL-1 (frame (LADY-MACBETH)) 

(slot (KILL)) 

(value (LADY-MACBETH))) 

(KILL-2 (frame (MACDUFF)) 

(slot (KILL)) 

(value (MACBETH))) 


The Parser 
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